Multiplicative Updatings for Support-vector Learning Produced as Part of the Esprit Working Group in Neural and Computational Learning Ii, Neurocolt2 27150
نویسنده
چکیده
Support Vector machines nd maximal margin hyperplanes in a high dimensional feature space. Theoretical results exist which guarantee a high generalization performance when the margin is large or when the number of support vectors is small. Multiplicative-Updating algorithms are a new tool for perceptron learning whose theoretical properties are well studied. In this work we present a Multiplicative-Updating algorithm for learning Support Vector machines which exploits the particular structure of high-generalization hypotheses, by achieving fast rate of convergence just in those situations where high generalization can be obtained, namely small number of support vectors or large margin.
منابع مشابه
Dynamically Adapting Kernels in Support Vector Machines Produced as Part of the Esprit Working Group in Neural and Computational Learning Ii, Neurocolt2 27150
The kernel-parameter is one of the few tunable parameters in Support Vector machines, and controls the complexity of the resulting hypothesis. The choice of its value amounts to model selection, and is usually performed by means of a validation set. We present an algorithm which can automatically perform model selection and learning with no additional computational cost and with no need of a va...
متن کاملLatent Semantic Kernels for Feature Selection Produced as Part of the Esprit Working Group in Neural and Computational Learning Ii, Neurocolt2 27150
Latent Semantic Indexing is a method for selecting informative subspaces of feature spaces. It was developed for information retrieval to reveal semantic information from document co-occurrences. The paper demonstrates how this method can be implemented implicitly to a kernel deened feature space and hence adapted for application to any kernel based learning algorithm and data. Experiments with...
متن کاملNew Support Vector Algorithms Produced as Part of the Esprit Working Group in Neural and Computational Learning Ii, Neurocolt2 27150 Introduction 1
We describe a new class of Support Vector algorithms for regression and classiication. In these algorithms, a parameter lets one eeectively control the number of Support Vectors. While this can be useful in its own right, the parametrization has the additional beneet of enabling us to eliminate one of the other free parameters of the algorithm: the accuracy parameter " in the regression case, a...
متن کاملGeneralization Bounds via Eigenvalues of the Gram Matrix Produced as Part of the Esprit Working Group in Neural and Computational Learning Ii, Neurocolt2 27150
Model selection in Support Vector machines is usually carried out by minimizing the quotient of the radius of the smallest enclosing sphere of the data and the observed margin on the training set. We provide a new criterion taking the distribution within that sphere into account by considering the Gram matrix of the data. In particular, this makes use of the eigenvalue distribution of the matri...
متن کاملLearning via Internal Representation Produced as Part of the Esprit Working Group in Neural and Computational Learning Ii, Neurocolt2 27150
We present a learning framework based on reducing a learning task to the problem of nding a good internal representation of the input examples ; a good internal representation is a set of features, relative to which a simple generalization rule, such as a linear hyperplane classiier, can be applied to obtain a good approximation of the target. Finding a good internal representation of a learnin...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1998